Uncontrollability of suicidal ideation adds incremental explanatory power in prediction of later suicidal ideation.

OBJECTIVE: Suicidal ideation and suicidal behaviors are major public health concerns in the United States and are difficult to treat and predict. Risk factors that are incrementally informative are needed to improve prediction and inform prevention of suicidal thoughts and behaviors. Uncontrollability of suicidal ideation, one parameter of suicidal ideation, is one such candidate. METHOD: In the current study, we assessed the predictive power of uncontrollability of suicidal ideation, over and above overall suicidal ideation, for future suicidal ideation in a large sample of active-duty service members. A total of 1044 suicidal military service members completed baseline assessments, of whom 664 (63.6%) completed 3-month follow-up assessments. RESULTS: While baseline overall suicidal ideation itself was the strongest predictor of future suicidal ideation, uncontrollability of suicidal ideation added some incremental explanatory power. CONCLUSION: Further study of uncontrollability of suicidal thought is needed to elucidate its impact on suicidal outcomes.

Three-year follow-up of suicide prevention-focused group therapy for veterans.

The purpose of this study was to determine the long-term effects of a suicide prevention-focused group therapy for veterans recently discharged from an inpatient psychiatry setting following a suicidal crisis. There was interest in examining the impact of mechanisms of change identified in previous research on the group, including group cohesion, working alliance, and group sessions attended. Data were abstracted from the electronic medical record 3 years following completion of a previous study that involved the group therapy. A series of generalized linear and logistic mixed models were conducted to measure the associations between group cohesion, working alliance, session attendance, and health service utilization and suicide attempts. Thirty randomly selected veterans from the original sample completed a semistructured interview to discuss their experience in the group therapy. Study team members reviewed each transcription to identify themes related to veterans' experiences in the suicide prevention-focused group therapy. No suicides were observed in the 3-year follow-up period. When examining the full sample (N = 134), session attendance and inpatient hospitalization were not significantly associated but were positively associated after removing subjects who attended zero sessions (N = 93). Higher group cohesion was associated with a reduced likelihood of inpatient psychiatric hospitalization and greater engagement in outpatient mental health services. Four themes emerged regarding veterans' experience in the group through an analysis of the semistructured interviews. Suicide prevention-focused group therapy among veteran service members was not associated with an elevated risk of mortality. Future research is needed to further elucidate mechanisms of change and moderators of response. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Optimizing the Beck Scale for Suicide Ideation: An Item Response Theory Approach Among U.S. Military Personnel.

The Beck Scale for Suicide Ideation (BSS) is one of the most used and empirically supported suicide risk assessment measures for behavioral health clinicians and researchers. However, the 19-item BSS is a relatively long measure and can take 5 to 10 minutes to administer. This study used Item Response Theory (IRT) techniques across two samples of mostly U.S. military service members to first identify (n1 = 1,899) and then validate (n2 = 757) an optimized set of the most informative BSS items. Results indicated that Items 1, 2, 4, 6, and 15 provided a similar-shaped test information curve across the same range of the latent trait as the full-length BSS and showed reliable item functioning across participant characteristics. The sum score of these five items showed a linear score linkage with the full-scale score, ρ > 0.87, and was equally as sensitive as the full scale for prospectively predicting near-term suicidal behavior at 74% with a cut score ≥1 (equivalent to full-scale score ≥6). Results are consistent with those from civilian samples. In time- or length-limited assessments, using these five BSS items may improve administration efficiency over the full BSS, while maintaining classification sensitivity.This study suggests that summing Items 1, 2, 4, 6, and 15 of the Beck Scale for Suicide Ideation (BSS) is an acceptable approach for shortening the full-length measure.

Pilot study of the Collaborative Assessment and Management of Suicidality-Group.

INTRODUCTION: Few evidence-based options exist for outpatient treatment of patients at risk of suicide, and to-date almost all research has focused on individually delivered psychotherapy. Group therapy for veterans at risk of suicide is a promising alternative. METHODS: Thirty veterans receiving care at an urban Veterans Affairs Medical Center in the southern United States were randomized to either care as usual (CAU) or to CAU plus the Collaborative Assessment and Management of Suicide-Group (CAMS-G). Veterans were assessed prior to randomization to condition and at 1, 3, and 6 months post-randomization on a range of suicide-specific measures, burdensomeness, belonging, treatment satisfaction, and group cohesion. RESULTS: Across measures and follow-up assessments, veterans in CAMS-G reported good satisfaction with the intervention, a sense of cohesion with other members of the group, and reduced symptom distress. Veterans in both conditions reported decreases in suicidal ideation and behavior, with CAMS-G participants potentially improving slightly faster. CONCLUSION: This description of CAMS-G for veterans adds to the growing literature on suicide-specific interventions and supports the need for additional research to determine if wide-spread rollout is justifiable.

Past Levels of Mental Health Intervention and Current Nondisclosure of Suicide Risk Among Men Older Than Age 50.

Suicide risk screening depends heavily on accurate patient self-report. However, past negative experiences with mental health care may contribute to intentional nondisclosure of suicide risk during screening. This study investigated among 282 men older than age 50 whether likelihood for current explicit risk nondisclosure was associated with previous highest level of mental health care received. This sample was selected post hoc out of a larger sample of participants from higher risk and lower help-seeking populations (i.e., military service members and veterans, men older than age 50, and lesbian gay bisexual, transgender, and queer young adults), however, the other groups were underpowered for analysis. Among these men, history of psychiatric hospitalization was significantly associated with likelihood for explicit nondisclosure of current suicide risk, while history of receiving only outpatient therapy for suicidal thoughts or behaviors was significantly associated with likelihood for full reporting of suicide risk. Severity of suicidal ideation and internalized stigma against mental illness were significant indirect contributors to the effect. Although causality could not be determined, results suggest that a potential cost to consider for psychiatric hospitalization may be future nondisclosure of suicide risk. Conversely, outpatient interventions that appropriately manage suicidal thoughts or behaviors may encourage future full reporting of suicide risk and improve screening detection.

The Role of Past Suicidal Behavior on Current Suicidality: A Retrospective Study in the Israeli Military.

Past suicide attempts are a significant risk factor for future suicidality. Therefore, the present military-based study examined the past suicidal behavior of soldiers who recently made a severe suicide attempt. Our sample consisted of 65 active-duty soldiers (61.5% males), between the ages of 18 and 28 years old (M = 20.4, SD ± 1.3). The inclusion criterion was a recent severe suicide attempt, requiring at least a 24 h hospitalization. This sample was divided into two groups, according to previous suicidal behavior, namely whether their first suicide attempt was before or after enlistment (n = 25; 38.5% and n = 40; 61.5%, respectively). We then examined the lethality and intent of the recent event in regard to this division. Four measures were used to assess the subjects' suicidal characteristics: the Columbia Suicide Severity Rating Scale, the Self-Harm Behavior Questionnaire, the Suicidal Behaviors Questionnaire-Revised, and the Beck Scale for Suicide Ideation. No significant difference in the severity of the suicide attempts (either actual or potential severity) were found between those who had suicide attempts before enlistment and those who had their first attempt in the service. As a matter of fact, most of the suicide attempts that occurred for the first time during military service had used a violent method (58.3%, n = 21). Finally, using multivariate analyses, we found that current thoughts and behavior, rather than past suicidality, was the strongest predictor for the lethality of suicide attempts.

Clinical utility of suicide behavior and ideation measures: Implications for military suicide risk assessment.

To date, the field has been unable to provide a definitive answer on which suicide risk assessment measure or set of measures is most useful in applied clinical settings. This study pits several psychometrically sound suicide risk assessment measures against one another, to determine which tool optimally assesses the likelihood of future suicide-related outcomes over a 3-month period, in a large sample of military personnel seeking and/or referred to services due to suicide risk concerns. The risk assessment measures were (a) Columbia-Suicide Severity Rating Scale; (b) Self-Harm Behavior Questionnaire; (c) Suicidal Behaviors Questionnaire-Revised; and (d) Beck Scale for Suicide Ideation. A total of 1,044 suicidal military service members completed baseline assessments, of whom 758 (72.6%) completed 3-month follow-up assessments. The data indicate that there is no best measure for suicide risk assessment and clinicians are therefore encouraged to select the measure, from among the four studied, for use in regular practice that best suits the demands of their setting. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Autism-related traits and suicide risk among active duty U.S. military service members.

Suicide rates within the U.S. military are elevated. The interpersonal theory of suicide, supported within military samples, suggests that social disconnectedness confers risk for suicide. Autism spectrum disorder (ASD) is characterized by symptoms-difficulties in social communication/interaction (SCI) and restricted and repetitive behaviors (RRBs)-that contribute to social disconnectedness. To our knowledge, no study has examined ASD-related traits and suicide risk among active duty U.S. military service members. Participants included 292 active duty U.S. military service members (M [SD] age = 28.67 [7.40] years, 68.5% male, 78.1% White). The Autism Spectrum Quotient, Repetitive Behaviours Questionnaire-2 for Adults, Self-Injurious Thoughts and Behaviors Interview-Short Form, and Interpersonal Needs Questionnaire assessed for SCI difficulties, RRBs, suicidal symptoms, and interpersonal theory of suicide constructs (i.e., perceived burdensomeness, thwarted belongingness), respectively. Elevated levels of SCI difficulties and RRBs were associated with increased odds of reporting suicidal thoughts and behaviors occurring since joining the military, controlling for the number of years of service and suicidal symptoms occurring prior to joining the military. Perceived burdensomeness and thwarted belongingness statistically accounted for the relationship between ASD-related traits and suicidal ideation occurring since joining the military; a rival mediator, emotion dysregulation, was not a significant mediator. Among active duty U.S. military service members, greater ASD-related traits were associated with an increased likelihood of reporting suicidal thoughts and behaviors occurring since joining the military. Clinical efforts targeting perceived burdensomeness and thwarted belongingness might reduce suicide risk among military service members with elevated ASD-related traits. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Psychological Problems among 12th-Grade Students Predicting Military Enlistment: Findings from the Monitoring the Future Survey.

Objective: Rates of some psychological disorders are higher among enlisted U.S. military personnel than socio-demographically matched civilians. Indirect evidence suggests some internalizing and externalizing psychological problems among enlistees onset prior to enlistment. However, the consistency and strength of the associations between pre-enlistment psychological problems and enlistment over time is unknown. We address this uncertainty by examining whether internalizing and externalizing problems in high school predicted subsequent military enlistment using a large cohort-sequential panel study. Method: The Monitoring the Future study administered baseline surveys from 1989-2014 and biennial follow-up surveys two and four years later to national samples of high-school seniors (N = 20,823). Validated self-report scales assessed internalizing (depression, low self-esteem) and externalizing (risk-taking, school misbehavior, conduct disorder, interpersonal violence, alcohol, and drug use) problems in each survey. Follow-up surveys assessed military enlistment. Logistic regression models were used to estimate associations of problems scales with subsequent enlistment. Results: School misbehavior in 12th grade, and risk-taking in 12th grade and two years after graduation were associated with significantly elevated odds of enlistment at follow-up. Although modest, these associations were linear and invariant across respondent sex and baseline survey year. Conclusions: School misbehavior and risk-taking predicted subsequent enlistment and there was no evidence of historical changes in these associations over the course of 25 years; these pre-enlistment psychological problems do not fully explain the high rates of psychological disorders among enlisted military personnel. Further research is needed to determine whether these predictors are associated with negative outcomes during or after military service.

A test of the interpersonal theory of suicide in a large, representative, retrospective and prospective study: Results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).

The interpersonal theory of suicide hypothesizes that perceived burdensomeness, thwarted belongingness, and hopelessness lead to active suicidal thoughts and individuals with active suicidal thoughts and elevated capability for suicide are most likely to attempt suicide. We retrospectively and prospectively tested this theory in a large sample of 7677 U.S. Army soldiers followed post-deployment for up to nine months. The interaction of perceived burdensomeness and hopelessness (OR = 2.59) was significantly associated with lifetime suicidal thoughts; however, the interactions of thwarted belongingness and perceived burdensomeness and of thwarted belongingness and hopelessness were not. Consistent with the theory, capability for suicide prospectively predicted suicide attempts during and following deployment (OR = 1.22); however, among soldiers reporting lifetime suicidal thoughts, capability did not predict attempts, only perceived burdensomeness did (OR = 1.36). Results supported some, but not all, theory hypotheses, suggesting that additional constructs may be needed to better identify the psychological factors that lead soldiers to attempt suicide.

Military Suicide Research Consortium common data elements: Bifactor analysis and longitudinal predictive ability of suicidal ideation and suicide attempts within a clinical sample.

To enhance and standardize the assessment of suicidal self-directed violence (SDV) in military populations, the Military Suicide Research Consortium developed the Common Data Elements (CDEs). Previous research supported the CDEs as assessing a higher-order factor of suicidal SDV in military populations. The present study had two aims: 1) confirm the bifactor structure of the CDEs in a high-risk sample, and 2) assess the ability of the factorially derived suicidal SDV factor to predict suicide attempts and return to care for suicidal ideation over 3-month follow-up. Utilizing a sample of service members referred for a psychiatric evaluation (N = 1,044), the CDE structure was assessed with confirmatory bifactor modeling. Logistic regressions and receiver operating characteristic (ROC) analyses were used to assess the suicidal SDV risk factor's prediction of suicide attempts and return to care for suicidal ideation during follow-up (n = 758). Bifactor modeling suggested adequate fit for the overarching suicidal SDV risk factor. Logistic regressions supported the overarching suicidal SDV risk factor as a predictor of suicide attempts (OR = 4.07, p < .001) and return to care for suicidal ideation (OR = 2.81, p < .001) over follow-up. However, ROC analyses suggested that the model including the suicidal SDV risk factor was only significantly better at classifying suicide attempts over follow-up (not return to care for suicidal ideation) than the model that did not include it (AUC difference = 0.15, p < .001). Findings suggest that the shared variance assessed across CDEs better predicts future suicide attempts beyond any individual suicide-related constructs. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Improving Our Understanding of the Death/Life Implicit Association Test.

The "Death/Life" Implicit Association Test (d-IAT) is a reaction-time task which has been associated with past and future suicidal behavior; in some work, the association has been incremental to explicit self-report of suicide risk. Proposed mechanisms for this association relate to one's unwillingness or inability to completely disclose or be introspectively aware of implicit risk. This study investigated moderators of implicit-explicit concordance as well as predictors of d-IAT score unexplained by self-reported suicidal thoughts and behaviors among an online sample of 382 adults with higher demographic suicide risk (i.e., military service members and veterans, men over age 50, and LGBTQ young adults). Before and after controlling for current explicit report, results replicated the finding of a significant relationship between d-IAT score and severity of past suicidal behavior, and additionally indicated that suicide attempt history and wish to live moderated the association between d-IAT score and explicit report. Furthermore, results suggest that poor introspective awareness, rather than deception, may account for differences between implicit and explicit risk assessment. Continuing investigation of moderators and mechanisms of the d-IAT is needed to improve the utility and validity of using implicit suicide risk assessment as a clinical tool.

An Examination of the Psychometric Properties of the Reasons for Living Inventory within a Male Veteran Clinical Sample.

Elevated suicide risk among veteran populations remains a significant public health concern. However, few suicide assessment measures have been validated for veterans. The current study evaluated the reliability and validity of the Reasons for Living Inventory (RFL) scores among veteran populations. The participants included male veterans (N = 421) from a broad range of ages, combat exposures, and history of suicide attempts. Participants completed the RFL and a set of additional self-report measures of relevant constructs in a cross-sectional design. Estimates of internal consistency reliability were adequate for scores on all the original RFL subscale scores. Exploratory factor analysis (EFA) and exploratory bifactor (bi-factor EFA) analyses provided detailed information regarding the 6-factor solution from the original validation studies with the RFL. Additional analyses identified potential correlates for the RFL total and subscale scores. Secondary analyses showed support for evidence of known-groups validity for the RFL total scale score. Overall, this study provides initial support for the RFL as a reliable and valid measure of protective factors in veterans. Future studies may wish to consider further validation of the current findings.

Pre-deployment predictors of suicide attempt during and after combat deployment: Results from the Army Study to Assess Risk and Resilience in Servicemembers.

BACKGROUND: Deployment-related experiences might be risk factors for soldier suicides, in which case identification of vulnerable soldiers before deployment could inform preventive efforts. We investigated this possibility by using pre-deployment survey and administrative data in a sample of US Army soldiers to develop a risk model for suicide attempt (SA) during and shortly after deployment. METHODS: Data came from the Army Study to Assess Risk and Resilience in Servicemembers Pre-Post Deployment Survey (PPDS). Soldiers completed a baseline survey shortly before deploying to Afghanistan in 2011-2012. Survey measures were used to predict SAs, defined using administrative and subsequent survey data, through 30 months after deployment. Models were built using penalized regression and ensemble machine learning methods. RESULTS: Significant pre-deployment risk factors were history of traumatic brain injury, 9 + mental health treatment visits in the 12 months before deployment, young age, female, previously married, and low relationship quality. Cross-validated AUC of the best penalized and ensemble models were .75-.77. 21.3-40.4% of SAs occurred among the 5-10% of soldiers with highest predicted risk and positive predictive value (PPV) among these high-risk soldiers was 4.4-5.7%. CONCLUSIONS: SA can be predicted significantly from pre-deployment data, but intervention planning needs to take PPV into consideration.

Economic Evaluation of Brief Cognitive Behavioral Therapy vs Treatment as Usual for Suicidal US Army Soldiers.

Importance: Brief cognitive behavioral therapy (BCBT) is a clinically effective intervention for reducing risk of suicide attempts among suicidal US Army soldiers. However, because specialized treatments can be resource intensive, more information is needed on costs and benefits of BCBT compared with existing treatments. Objective: To evaluate the cost-effectiveness of BCBT compared with treatment as usual for suicidal soldiers in the US Army. Design, Setting, and Participants: A decision analytic model compared effects and costs of BCBT vs treatment as usual from a US Department of Defense (DoD) perspective. Model input data were drawn from epidemiologic data sets and a clinical trial among suicidal soldiers conducted from January 31, 2011, to April 3, 2014. Data were analyzed from July 3, 2018, to March 25, 2019. Interventions: The strategies compared were treatment as usual alone vs treatment as usual plus 12 individual BCBT sessions. Treatment as usual could include a range of pharmacologic and psychological treatment options. Main Outcomes and Measures: Costs in 2017 US dollars, suicide attempts averted (self-directed behavior with intent to die, but with nonfatal outcome), suicide deaths averted, and incremental cost-effectiveness ratios, assuming a 2-year time horizon for treatment differences but including lifetime costs. Results: In the base-case analysis, BCBT was expected to avert approximately 23 to 25 more suicide attempts and 1 to 3 more suicide deaths per 100 patients treated than treatment as usual. Sensitivity analyses assuming a range of treatment effects showed BCBT to be cost saving in most scenarios. Using the federal discount rate, the DoD was estimated to save from $15 000 to $16 630 per patient with BCBT vs treatment as usual. In a worst-case scenario (ie, assuming the weakest plausible BCBT effect sizes), BCBT cost an additional $1910 to $2250 per patient compared with treatment as usual. Conclusions and Relevance: Results suggest BCBT may be a cost-saving intervention for suicidal active-duty soldiers. The costs of ensuring treatment fidelity would also need to be considered when assessing the implications of disseminating BCBT across the entire DoD.

Investigating the reliability of suicide attempt history reporting across five measures: A study of US military service members at risk of suicide.

OBJECTIVE: Utilizing a sample of military service members at risk of suicide, this study aimed to: (a) identify patterns of suicide attempt (SA) history reporting across five measures and (b) evaluate whether consistent SA reporters (i.e., individuals who consistently report an SA history across measures) differ from inconsistent SA reporters on other clinical severity indices. METHOD: Participants (N = 984) completed five validated SA history measures and self-report psychiatric symptom measures. RESULTS: Of the sample, 35.4% inconsistently responded to SA history measures. Inconsistent reporters disclosed more severe suicide threat histories than consistent reporters. On all other clinical severity indices, inconsistent reporters evinced either less severe or comparable symptom levels. CONCLUSIONS: A nontrivial portion of service members may respond inconsistently to different assessments of SA history. Research is needed to identify factors that account for inconsistent SA history reporting and to improve the accuracy of SA history assessments among military personnel.

Assessment of a Risk Index for Suicide Attempts Among US Army Soldiers With Suicide Ideation: Analysis of Data From the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).

Importance: The Department of Veterans Affairs recently began requiring annual suicide ideation (SI) screening of all patients and additional structured questions for patients reporting SI. Related changes are under consideration at the Department of Defense. These changes will presumably lead to higher SI detection, which will require hiring additional clinical staff and/or developing a clinical decision support system to focus in-depth suicide risk assessments on patients considered high risk. Objective: To carry out a proof-of-concept study for whether a brief structured question battery from a survey of US Army soldiers can help target in-depth suicide risk assessments by identifying soldiers with self-reported lifetime SI who are at highest risk of subsequent administratively recorded nonfatal suicide attempts (SAs). Design, Setting, and Participants: Cohort study with prospective observational design. Data were collected from May 2011 to February 2013. Participants were followed up through December 2014. Analyses were conducted from March to November 2018. A logistic regression model was used to assess risk for subsequent administratively recorded nonfatal SAs. A total of 3649 Regular Army soldiers in 3 Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) surveys who reported lifetime SI were followed up for 18 to 45 months from baseline to assess administratively reported nonfatal SAs. Main Outcomes and Measures: Outcome was administratively recorded nonfatal SAs between survey response and December 2014. Predictors were survey variables. Results: The 3649 survey respondents were 80.5% male and had a median (interquartile range) age of 29 (25-36) years (range, 18-55 years); 69.4% were white non-Hispanic, 14.6% were black, 9.0% were Hispanic, 7.0% were another racial/ethnic group. Sixty-five respondents had administratively recorded nonfatal SAs between survey response and December 2014. One additional respondent died by suicide without making a nonfatal SA but was excluded from analysis based on previous evidence that predictors are different for suicide death and nonfatal SAs. Significant risk factors were SI recency (odds ratio [OR], 7.2; 95% CI, 2.9-18.0) and persistence (OR, 2.6; 95% CI, 1.0-6.8), positive screens for mental disorders (OR, 26.2; 95% CI, 6.1-112.0), and Army career characteristics (OR for junior enlisted rank, 30.0; 95% CI, 3.3-272.5 and OR for senior enlisted rank, 6.7; 95% CI, 0.8-54.9). Cross-validated area under the curve was 0.78. The 10% of respondents with highest estimated risk accounted for 39.2% of subsequent SAs. Conclusions and Relevance: Results suggest the feasibility of developing a clinically useful risk index for SA among soldiers with SI using a small number of self-report questions. If implemented, a continuous quality improvement approach should be taken to refine the structured question series.

Predicting suicide attempts among soldiers who deny suicidal ideation in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).

Most nonfatal suicide attempts and suicide deaths occur among patients who deny suicidal ideation (SI) during suicide risk screenings. Little is known about risk factors for suicidal behaviors among such patients. We investigated this in a representative sample of U.S. Army soldiers who denied lifetime SI in a survey and were then followed through administrative records for up to 45 months to learn of administratively-recorded suicide attempts (SA). A novel two-stage risk assessment approach was used that combined first-stage prediction from administrative records to find the subsample of SI deniers with highest subsequent SA risk and then used survey reports to estimate a second-stage model identifying the subset of individuals in the high-risk subsample at highest SA risk. 70% of survey respondents denied lifetime SI. Administrative data identified 30% of this 70% who accounted for 81.2% of subsequent administratively-recorded SAs. A relatively small number of self-report survey variables were then used to create a prediction model that identified 10% of the first-stage high-risk sample (i.e., 3% of all soldiers) at highest SA risk (accounting for 45% of SAs in the total sample). We close by discussing potential applications of this approach for identifying future SI deniers at highest SA risk.

Assessing the Reliability of the CAMS Rating Scale Using a Generalizability Study.

Background: An important consideration when conducting randomized controlled trials is treatment differentiation. Direct observation helps ensure that providers in different treatment groups are delivering distinct interventions. One direct observation method is the use of a measure to rate clinician performance when delivering an intervention. Aims: This generalizability study evaluated the reliability of the CAMS Rating Scale (CRS), a measure used to assess delivery of the Collaborative Assessment and Management of Suicidality (CAMS). Method: Digitally recorded tapes of clinicians delivering either CAMS or Enhanced Care-As-Usual (E-CAU) were coded using the CRS. Sessions (N = 36) were each coded by two raters, and encompassed four clinicians, four time points, and 34 unique patients across two treatment groups. A reliability coefficient (i.e., G coefficient) and the percentages of variance contributed by each component of the measurement model were obtained. Results: The CRS reliably differentiates CAMS from E-CAU, minimizes measurement error relative to expected variance sources, and continues to demonstrate high inter-rater reliability. Limitations: The absence of blind raters, a formal training protocol for the rating team, and ratings from all clinician-patient dyads at all time points was a limitation. Conclusion: The CRS is a reliable treatment differentiation measure that can play an integral role in studies evaluating CAMS.